| 1 | 1,021 | 1,360 | mechanize | The Mechanize library is used for automating interaction with websites.
Mechanize autom... |
| 2 | 4,917 | 7,401 | anemone | Anemone web-spider framework |
| 3 | 5,909 | 7,568 | link_thumbnailer | Ruby gem generating thumbnail images from a given URL. |
| 4 | 8,561 | 5,839 | spidr | Spidr is a versatile Ruby web spidering library that can spider a site, multiple domain... |
| 5 | 10,374 | 10,258 | wombat | Generic Web crawler with a DSL that parses structured data from web pages |
| 6 | 23,959 | 143,384 | upton | Don't re-write web scrapers every time. Upton gives you a scraper template that's easy ... |
| 7 | 69,083 | 64,836 | fake_useragent | Simple gem for generating valid web user agents. |
| 8 | 119,340 | 32,489 | ronin-web-spider | ronin-web-spider is a collection of common web spidering routines using the spidr gem. |
xmisao